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ABSTRACT 

The document presents a summary description of the 
Air Force Human Resource Laboratory's FlyiTig Training Division 
(AFHRL/FT) research capabilities for undergraduate pilot training. 
One of the research devices investigated is the Jldvanced Simulator 
for Undergraduate Pilot Training (ASDPT) . The equipment includes the 
ASOPT, the instrumented T-37 aircraft, the T-UG and T-UO trainers, 
and the formation flight trainer. Methodological considerations and . 
the development of a research program are discussed. Instructional 
procedures and practices are described for three phases which will be 
used in establishing a technological Ijase: equipment familiarization 
and operator performance measures for the T-UO study, ASTIPT, and 
instrumented aircraf t^^One area of •suggested research is visual 
display which will include investigation of visual cues, the use of a 
visual model as a research tool, and four studies on the content of 
visual display. Another area for suggested study is motion cue 
research which will attempt to determine the necessary ates^ bf. 
cockpit motion for training simulation. A third area of suggested 
research focuses on training methods in the areas of cognitive 
pretraining^ feedback, sequencing of traini^ig tasks, contextual 
training, aiid individualized training j A list of reference^ is 
included. A list of AFHRL/FT research programs for 1975 is appended. 
(3C) ( 
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PREFACE 



' This report was^ completed under Project 1123, USAF Flying Training 
Development; Task 112303, The Exploitation of Simulation in- Plying Training; Work 
Unit' 11230307, Handbook of Research Designs for Advanced Simulation in 
TTnrlprgniHnate Pilot Training Dr William V. Hagin was project scientist and Dr. Thomas 
H.Giay was c o nt r act monitor . 



AFHRLa'R-75-26(I) is based upon work dbne by Life Sciences, Incorporated (LSI) 
under USAF Contract F41609.73<:-0038 and documented in LSI Technical Report 74-1,- 
'Traming Research Program and Plans. Advanced Simulation in Undergraduate Pilot 
Training;' (Matheny, 1974). The LSt report (AFHRL.TR.75^26(10) was based upon 
work >done before the Advanced Simulator for Undergraduate Pilot Traimng (ASUPT) 
was fuUy developed and was published shortly before ASUPT was formally accepted. 
AFHRL-TR-75-26(l) not only provides an executive summary for the LSI report, but also 
adds reality to what hasbeenconceptualplanning; Appendix A specifies the issues which 
wUl be investigated this year and depicts AFHRL/FT facility programming during the 
first calendar year of P^^^ operation. 
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AFHRL/FT CAPABILITIES IN UNDERGRADUATE PILOT 
TRAINING SIMULATION RESEARCH: 
EXECUTIVE SUMMARY 

t 

I. I^^^R0Duc^0N and approach • 4. , 

A 

^The nuiion oRhciir^Fo7Je Human ResouKe'Lab^ t oryN FiylHeTr ainingPI^ 
to "improve nying trainmg" through the development and evaluation of innovative training methods and 
-?!svTrfi s A so ul iis tic a t eJ Hk:Hrtv^onsin g--a-iiumbef--6l^^intflue pilot^-^raining^^esearch devices:has been - 
developed at Williams Air Force Base, Arizona to accompfishr'^Jiis nussion. Qfihese devices, the Advanced 
Simulator for Undergraduate Pilot Training (ASUPT) has the greatest potential for the investigation and 
resolution of flying training issues. 

ASUFT has been designed to be a state-of-the-art research device with every advanced capability that 
flieht simulator technology ctn provide, visual and motion cueing and advanced training features. It will be 
systematically usecLin research studies to validate the contribution of altemate hardware configuration an^ 
training methodology combinations to pUot training. Emphasis will be focused upon undergraduate pilot 
training (UPT). but generalizability to other pilot training programs is also considered highly important. 

The exceptional capabilities o? ASUPT and the broad spectrum of possible research tasks, coupled 
with heavy workload and an acute shortage of in-house manpower, justified a decision to contract for 
identification of the simulator design and training research problems considered most important on 
cost/benefit criteria and delineation of the AFH^L/FT efforts .appropriate for efficient utihzation of 
facility resources. In addition, methpdological outlines of first priorhy studies were required. . 

Tliere were three phases in the contractual work effort: (1) development of a Ust of priority research 
issues. (2) assessment of the research facility capability, and (3) recommendation of the initial- 
investigations to be performed. 

11. PRIORITY RESEARCH ISSUfeS 

The inventory of priority research issues was develop! in tjvo steps. In step one. a list of research 
issues was generated by canvassing a "panel" of selected individuals recognizedjjs experts'in the field of 
pOo tuning and related research. AFHRL-TR-75-26(ll). Appendix A lists their names and cmen 
Srganizationfl afhliation and pLdes a copy of the letter of instruction sent to each. Each of the (welv 
panel members submitted a list of issues beUeved to .be most important 

inputs, combined with data from the contractor's literature review^, produced an initial listing of fifty-five 
possible research issues. 

In step two, the research issues were clarified, consolidated and returned as an unordered Bst to each 
expert The panel members were asked to .rank the issues accoi^fin^ to judged importance tising a modified 
pair comparisons technique. AFHRL-TR-75.26(II), Appendix B lists the research issues evaluated and 
AFHRL-TR^75-26(11), Appendix C is a facsimile of the rater instructions. Ten of the twelve panel inembers 
responded wiUi rankings of the research issues. AFHRL-TR-75-26^JI). Appendix D depicts the full hst of 
prioritized issues. 

The top and bottom priority issues, abstracted fro;n ARHRL-TR-75-26(II), Appendix D, are 
presented in Table 1 and Table 2. respectively. ■ ' 

Iir. CAPABILITIES OF THE AFHRL/FT RESEARCfl FAQLITY 

The research equipment at AFHRL/FT (fully described in ^Hagin and Smith. 1974) are briefly 
summarized. ' i ' 



The Advanced Simulator for Undergraduate Pilot Training (ASUPT) 1 

ASUFT is a two-cockpit. full-motion simulator with a wide-ailgle computer image generated (CIG) 
visual system. Motion cues are provided by a ,six^egree-of freedorA synergistic motion platform and a 

8 * 
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Table I. Rankings of Top Priority Research Issues 
(10 Raters) 



Ranking 



Median Rank 



Content of the Visual Display 
Motion-Vision Interaction 



6.0 

TT.n 



10.75 
11.50 



Qu ali ty o f tha Visual Diaplay 



tt:^ t9nT 

Performance-Measuremcnt-Sy^tenr — " : 

Output Measures ■|2.5 \27S 

Sequencing of Training Tasks 14.0 ]]\oO 

Contribution of the Individual or 

Combined Degx^es of Freedom of Platform 14.0 1 1 .75 

Instructor Training-Performance Evaluation 14.5 i ] .00 

Cognitive Pre-Traming , |5,o 9 75 

* Contextual Training . - ^ 22.0 9 OQ^ 

Adaptive Training ^ * 25.5 I0 7i 

T"^ ' ^ 

Table 2. Rankings of Lowest* Priority Research Issues / > 

f 10 Raters) 



5 
6 

7 * 
8 
9 
10 



Ranking 

46 
47 
48 

I 49 

50 
51 
52 

53 ' 



54 

5S 



Median Rank 



Instructional Aids Maneuver \)ctixni\\n\\um 

Extension of the Tramm^ Sylhibiis 

Contribution of the C;ravtfy ^Iffenmoni 

, Cue to Traming 

Disorientation 7 raining 

Feedback Time Delay 

Trainee Motivation 

Performance Mea<;urement Observer 

Opinion Data 
l>ererminariorj of the lfnf)orrancf; of rhr 

Auditory Spectra as a Means o7 Adding 

Realism to the "Iraininw Sifnahon 
Determinalion of rhe linporlairce of rlic 

Auditory Spectra as Infcrfeienct; or Noiso 
^ircrafr Dynainics SimnlatKyi 



?S 0 
0 

?S 0 
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\H 0 



40.0 

44 0 
4S.0 



ruliirivf If 
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1 4 75 
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II JS. 
10.00 
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X 00 



S.SO 

10.75 
18.75 



>l'»ni<>n an»<iii)' utctsiin J he 



G-seat. The 7-faccted display provides a representation of the'vhual scene similar to (hat seen from the T-37 
aircraft' >\S(iPf also has a pumber of advanced inslrucHonaf features designed to increase its training 
effectiveness, including selective malfunction insertion, .simulator freeze and rapid re4nitialuation: 
automated demonstration; self<onfrontation , and a aMmbcr of methods of providing student feedback. 

Instrumented T^37 Aircraft 

An instrumented T,37 aircraft is an important resource for obtaining basic data on pilot aircraft 
x^ntrol bchaVfof. It "is essential to testing the concept of perfornian$;a equivalence (Section IV) because it 
permits investigation'of the relationship betweerv pilot aircraft controFand aircraft system response. - 

The T-4G Trainer . - - 

A T4 instrument trainer on a two^egree-of-freedoWmotion platform with an electronic perspective 
transforntation (EPT) limited field-pf-view visual system provides a higli-quah'ty scene of the approach, 
landing and* take-off sequence. 
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The I-ormation Right Trainer (FFT) ^ 

The formation flight trainer is a lixed-base, part-task trainer which provides some of the essential 
visual cues for teaching basic formation Hight skillt. The cockpit has a stick, throttle rudder pedals and 
simple instrument displays. The FFT simulates the rudimentary flight dynamics of the T-38 or T37 ^ 
aircraft. A spherical screen provides a 200-degree horizontal and^O-degree vertical field-of-view. 

^ ^ i '- — = 



The T 4 0 Tra inet^ 



The J40 is an mstrurnenLand procedures^ trainer on a. two^degree-of-freedom motj^on system. It has a 
sid^-by-sidrseatingtc6clcpitwit¥Tnslrument pffi^fe^^ gu^iura rt<H«i H^u nd-tn-{h^9-awmtt^^ 

Other Equipment and Devices within HRL/FT 

(1) The automatic data acquisition and control system (ADACS) can be used with the T4G, T40 and 
FFT to record and process experimental data on up to 29 measurement parameters. (2) A helmet-mounted, 
eye7movement recorder can be used in aircraft or simulators to provide data on field of view and stimulus 
information used by the pilot (AFHRL-TR-75-26(II), Appendix F). (3) An audio-visual instructional 
facility' includes Video laboratory for the production of instructional presentations, a senes of learning 
center carrels and the audio-visual instrument training (AVIT) device developed by Life Sciences, Inc. 
AVIT presents visual and aural information with programmable branching in either mode. The student 
interacts with AVIT through simulated aircraft controls and multiple choice response keys 
(AFHRL-TR-75-26(II), Appendix G). - ' 

IV. METHODOLOGY AND RESEARCH PROGRAMMING 

hi appUed studies research methodoliagies and resource utilization inexorably intertwined. 
Procedures that may work well in the laboratory may be operationally infeasible if the equipment or 
techniques required are too "delicate" or'tostly. This issue will be briefly addressed in the following 
section. 

Methodological Considerations \ . 

The classical transfer of training paradigm is often used for research on truiaing methods and training 
effectiveness. Results are expressed as transfer* ratios (TRs), or when cost/benefit concern exists, as either 
transfer effectiveness ratios (TERs), or incremental transfer effectiveness ratios (ITERs) (Roscoe, 1974). 
Th^-^'running time" and subject requirements of these methods present real problems in an operational 
environment such as UFT. The primary problem lies in ^the flight and <=^«"da|Ume required for 
demonstrating skill transfer to the aircraft aftet-device training. The flexibility of ASUPT and the numbe 
of experiments possible demanded a search for alternative, m6re efficient methods Otherwise, the red 
dollar costs per study would be excessive and the total information output from the AFHRL/FI S30 
million facility /relatively low. 

Requirement for Alternative to Classical Transfer Approaches. A large number of studies can be done 
using ASUFT asUe criterion device if it couldbe sh'own that it is a valid representation of the T-37 aircratt 
For operational trainers, this has been partiaUy accompUshed.By implementingnhe mathematical model of 
the aircraft's flight dynamics as accurately as possible and par^ally by pilot evaluations dunng acceptance 
testing. For ASUPT to be used as a research criterion instrurrient, it is essentral that it be. more 
qua^ititatively validated as "T-37 equivalent." 

Performance Equivalence. The procedure for establishing ASUFT as T-37 equivalent has been termed 
"performance equivalence',' (Matheny, 1974). TliiS' concept hypothesizes that if pilot and system output 
measures are statistically equivalent whe,n "simulator artd aircraft are flown to specified tolerances the two 
devices-simulator and aircraft-are eijuivalent for training purposes. Equivalence is assumed to be estabbshed 
upon demonstration tbnt ^y^t«m performance (i.e., man and machine) under one set of conditions is not 



different from system performance under a reference set of conditions. 

• If ASUFT's performance equivalence becomes established, it can be the criterion sysjem-both for 
•many transfer of training experiments and for research which is impractical or inadvisable in the aircraft 



(e.g ,-atuations which impose safety hazards or unusual stresses on the aircraft). Establishing the utilitv-and 
vahdity of this technique fer ASUPT investigation? wiU also provide the. groundwork for its use in'Ee 
evaluation and calibration of other training simulators within the Air Force. - ' • 

The generalizabiUty of the fmdings on training method* and devices "obtained in this manner mieht be " 
questioned: it could be th^t results obtained using ASUPT as the criterion sysl^^ot v^r £rin , 
transfer of Uairung to the aireraf^If tluswerejr ue, the results vy Qiild_ak(UiQLbe valid in^ther-^imuIatoK - 
d^^Deth>as-4»^ .no>h.r H.>h.r 

conieniionis contrary to .loiig standing practice in education, and training: many training methods and 

^jques dpxelopcd,in,bne^ontekt.h^^^^^ proved valid when used across a variety of tSinTsSons - - 

Sinta foTtheTic'^f r^'^^'^ ^° ASUPT would he ef^^S 

raining for the aircraft, although no, traming method, procedure, or equipment can be "ftroved" effective 
until positive transfer to the aircraft.hasbeen'temonstrated 7 enecuve 

Research Program ^* ^ - ' 

resour« utlSinn U?"^ dtjeVoi^^fkt^, conceptual model in conjunction with considerations of 
resource utilization ajwljauiing9>vali^ation. ^^^^ j". Jfc. 

Progmm Afod^f^ twVmajor elements inj-the siiijested research program (Figure D ate" (1) the 

?2TeXatli^^'^"'''\"'''.°'''' f.?-™"^""^^"'^"^ '^<=hniq-^ as a technology ba« for ASUFl^ 1 
ShnnTl ^ '^r"?"'' validating .experiments in the research phase. Development of a \ 
Sitr'^procuSh'ent" '° gcneraUzable;to other training research program's and future 

The research phase of the program is divided into two parts: investigations of training methodology 
L"d rnSS°"oLl'"Ti''*°' requirements. Each of these areas is further divided into screenS^' 
^rlaht .nrt ^Cin h ^^/'o^atory (or screening) kase wUl systeinaticaUy reduce the number of 

^nableS and v<^dl be performed prior to formal experimen>ition. Results ol" exploratory experiments could 
ex^ri^ntalst r '"^^ '•"P'^"*"^ training *pctiveness without going through the formel 



Jc„ Jh"T! and siinulator hardware requireWnts are not mutually exclusive areas of 

research. Certain trammg methodologies require unique sim\ilator cftarapteristics. Conversely, certain 
simulator characteristics necessitate siSecific methodologies. 

the mST""* werfi two primary considerations used in the development of 

^..i,.hT"'^^ "f^'f" P'-ogramming. "For efficiejit resource utilization, research dealing with training 
methodologies and student progression should utilize the least Complex and most inexpensive devic Fo? 
example, the use of the T-40 and TAG simulators in .the T-37 UPT program demonstrated the wo h o 
WoLmff e7 »T tlTT f "iff^^^"^ draining approaches (Woodruff & Smith, 1975 

ni^ftnr \' f ^' '""P^nsive Simulators can also be valuable in the investigation of system and 
operator output performance jneasurements. v. jnu 

Dimensions for evaluating training A distinction is made^between efficient training economical 
trainmg, and effective trairtMg. Efficient training brings the student to the immediate trSg godTthe ' 
shortest trauiing time.. In many situations, however, criteAa other than time must be considered. Economic 
and human resources, noise abatement, and many other factors affect the evaluation of proposed training 
strategies. The decision maker must weigh these costs in terms of economical training apart from the time 
dimension used in assessing efficient training. If the skills acquired in attaining the immediate training goal 
can be applied in a larger training objective, the training is effective. For example, if the cue" used in 

t?aS h ""'"Jf ^"^r? ""^^ ^"''^''y '"eWy abstract display, we have a^ e??Jem 

raming technique. It wdl be an effective technique to the extent that the skUls acquired using tha 
technique can be gppbed in the larger, more realistic situations; i.e., positive transfer takes place.' 
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• V. ESTABLISHMENT OF A TECHNOLOGICAL BASE' 

» 

Establishing a technological base involves the 'development and test of procedures, measurement 
techniques, and equipment operation, necessarily antecedent to carrying out the research program. 
Although the technological base entafls establishing ASUPT as the criterion device for the conduct of 
experiments, it may also provide data supporting simulator design recommendations. 

Equipment Familiarization. During this phase, research personnel will gain familiarity with the 
equipment and establish operating procedlires for ASUPT. Information obtained on the mpst economical 
way of changing from one equipment condition to another will save valuable r«sources in later research. 

Small preliminary studies and investigations will collect data on tha reliability of the eljuipment-and 
identify idiosyncrasies withiji the system to aid planning future expe'nments. The type and frequency of ^ 
calibration necessary to keep the equipment functioning at an acceptable level will be established dunng 
this phase. The ^determination of experimenter and the instructor functions at the ASUPT console arid 
instructor stations is an important task to be accomplished during this phase. Since the two 
instructor/operator stations differ in terms of information available, the procedures and practices for 
providing^struction from each must be defined. ' } 

System Measures t • • ^ 

A complex system such as an aircraft or sifnulator may be evaluated at two points, system outputs 
(e.g., heading, airspeed and altitude measures) -and control inputs measuring control movement (e.g., 
throttle, stick and mdder). This model and the measurement points (MP) are shown symbolically in Figure 

2. ^ ^ 
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Figure 2. Performance measurement points (MP) in the man/machine system. 
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System output measures are referred to MP^ in Figure 2 and reflect the performance of the total 
man-machine system. Jn the aircraft, MP2 parameters are airspeed, heading, altitude, pitch or roil angle, etc. 
These measures must be developed and specified for each of the AFHRL/FT research devices (ASUPT, the 
instrumented airplane", the T-40 and T-4G trainers). The specification of these measures' is important 
thrpughout att phases of experimentation, although their use varies between training methodology and 
simulator requirerfients research. 

Valid, reliable measures have been developed for evaluating the precision of aircraft control in the 
simulator and airci^aft. However, criteria against which performance may be measured remain to be 
established for the majority of piloting tasks. System output measures are being jestablished by AFHRL/FT 
in-house and through contract efforts. The AFHRL/FT effort (Waag, 1974) emj)hasized that the major 
thrust in present .performance measurement development will produce measures which reflect system 
output performance. The AFHRL/FT ir^-house work will also define" the objectives for particular maneuvers 
or sequences of training tasks and develop criterion "measures for those particular objectives. These measures 
will. (1) determine thcdegree to which the criterion obje^ves are met, (2) be useful to the student and the 
instruct(y pilot, and (3) be generated on a real-time basis to provide immediate feedback. 

• • • 13 . - «^ . 

«. • 10 



/ 



Operator perfofmancQ measures define pilot inputs.into the system and depict behavioral responses to 
stimuli. They are distinguislied from system performance measures which are composed of pilot response 
plus the variability witlun the system he is controlling. 

Simple system output measures are necessary, but insufficient, since the human operator can adapt . 
his control behavior to produce the, same system output Thus, the simulator could reinforce control input 
behavior not positively transferable to the aircraft if the- simulator system differs signifi(rantly from the 
aircraft system. Concern with the control input parameters reflects the desire to train in a simulator the 
skills required for precise control of the aircraft. ) 

Measunng operator behavior at the control input [ioint is fundamental to investigating the validity of 
the concept of performance equivalence. If the experienced pilot is to be a "calibrated" control element 
and IS observed to determine tinder what conditions his-cgntrol input behavior changes while system 
performance remains constant, a Reliable description of ^lot control behayior is necessary. This measure 
must be sensitive to cftanges in task conditions such ^as the dynamics of the system (e.g.. changes in 
simulator motion parameters). . ' * I 

Previous work has shown that measures "such a^ the power density spectrum, the breakpoint 
frequency of the transform of that spectrum and the ftercentage of power in selected portioris of the 
spectrum are summary measures which reflect meaningful changes in operator behavior as functions of 
changes m the conditions of the task (Nonnan 1973; Matheny et al.. 1974). The reliability of these 
summary measures and their inter-relationship needs to be established. An examination and analysis of pilot 
control output behavior across a range of conditions of systen^ disturbances and of requirements for control 
(i.e., maneuvers or tasks) is needed: The behavior ef the human controller in a complex closed-loop system 
is exhibited as a complex time varying output through the controls of the system. A simple, direct and^ 
preferably "on-line'* summarization of this output is desired^ ^ 

For experiments in which operator output measures are^b^eing examined, the pilot must control the 
system to a prescribedMevel of performance. System perfdjgpnce must be constant so that pilot input 
changes are reflected in changes in the operator's conbrol out^. if such changes do not result in changes in 
the experienced operator's control behavior, the conditions being studied arc concluded tp be behaviorally 
equivalent. 

Technological Base Experimentation 

The ASUPT. T40 and T4G simulators, and the mstrume^ted T-37 aircraft are systems which have 
' the capabflity for manipulation of system dynamics and can provide answers to practical questions 
regarding simulation requirments. The specific studies, outlined Subsequently, are subjf^t to modifications 
based uppn hardware and software constraints and the results of prior experiments. 

Operator Performance Measures. T~40^Stucl'y. Investigations using the T-40 simulator will examine 
procedures for summarizing time-varying operator output from the controls, for examining ittdividual 
differences in pilot output measures, and for determining the stability of these measures. The conditions of 
the experiment are given in Table 3. 

sJaWe 3. Experimental Conditions for fnvestigatin^ 
Performance Measures^in the T40 Trainer 









Variables 






Condition * 


Turbulence Level 


Trainer Motion 


Maneuvers 




1 


Low 


On 


St §i Level 




2 


Moderate 


On 


St & Level 




3 


High 


On 


St & Level 




4 


Low 


Off 


St & Level 




5 


Moderate 


' Off 


St & Level ' 


- 'i 


. 6 


High 


■Off 


*St & Level 




7 


Low 


On 


30"" bank turn 




8 


Moderate 


On 


3a'' bank turn 


• 


^ 9 


High 


On 


30*^ bank turn 




10 


Low 


Off 


30° bank turn 




. 11 


Moderate 


Off 


30^ bank turn 




• 12 


High 


Off 


30"^ bank turn 




« 
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Five experienced instructor pilots will.serve as subjects, trials are two minutes in duration. Slibjects 
practice- straight and level ^nd 30'' left bank maneuvers under each condition until Ihey reach criterion 
performance on the system output measures of heading, altitude, airspeed, bank angle and pitch angle. 

Tlie order of trial conditions will^be counterbalanced between subjects to reduce order effects. 
Subjects will repeat the triSl the foDowing'day and again after one week. 

, The dependent measures are pilot control and system outputs after criterion perfopnance has been 
reached. The pilot control input measures are denved from fore-and-aft and lateral raovements of the sUck, 
and-movement of the throttle. • - 

Dependent variable measures should reflect pracUqc effects and stabilize aftexcnterign performance 
is achieved. Proposed measures are stick force (mean and mean square value), stick Z score and throttle Z 
score (Waagctal., 1975): and, cross-over power (Norman, 1973). 

The results of these analyses' will be used to guide the development of operator pcrformai\6e records 
^in ASUPT and the instrumented aircraft. 

Operator Performatwe Measures. ASUPT, This ASUPT experiment will essentially repeat the T-40 
study described above with "visual display" as an additional independent .variable, final selection of 
conditions wfll be^uided by results of tlie 140 experiment. This experiment examines the question of the 
interaction between the motion and visual display-in the si;nulator^Por planning purposes, the variables and 
levels listed in Table 4 will be investigated. , ^ . 

\ 

<» * ' ' 

Table 4. Experimental Conditions for Investigating Operator 
Performance Measures in ASUFT ... 



variables 



Condition 


Turbulence ' 


Platform Motion * 


Vi(u«t DUplay 


G-^eat 




• 

Low 


On 


On 


Off 


2 


High 


On 


On 


Off 


3 


Low 


On 


Off 


Off • 


4 


Hiih 


On 


Off 


Off 


5 


Low 


Off 


On 


Off 


6 


High 


Off 


On 


>Off 


7 


Low 


Off 


Off 


Off 


8 


High 


Off 


Off 


■ Off 


9 


Low 


On 


On 


On 


10 


High 


On 


On 


On 


II 


Low 


On 


Off 


On 


12 


High 


On 


Off 


On 


13 


Low 


Off 


• On- 


On 


14 


High 


Off 


On 


On 


15 


Low 


. Off 


Off 


^On 


16 


High 


Off 


Off 


On . 



The experimental paradigm is the same as the T40 experiment. Experienced pOots will practice each 
experimental condition to criterion at which time control outputs will be recorded over a two-minute trial. 

Thf* visual display for contact maneuvers will use a full field of view with a defirulKe horizon line 
with distinguishing features used as external referents for heading. , \ 

Operator Performance Afeasures: Instrumented Aircraft. Data collected in the instrumented aircraft 
provide the technological base against which performance in ASUPT will be compared. lifopefully, the 
comparability of the two devices will be established with respect to the closed-loop dyrfcmic tracking 
behavior required of the pilot in controlling the systems. r) 
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Pilm performance will be recorded in the instrumented T-37 aircraft across representative maneuvers 
and conditions. Summary mcdMires of the time varying control output will be obtained. Population 
parameters of meair and variance in performance outputs will be Estimated. 

Tlie measures to be recorded in iUc aiuraft are^iven m TaWe 5. Data collection conditions are shown 
in Table b. This table m^ustbe interpreted m conjunction with the lliglit pattern and sequence for recording 
trials depicted in Figures 3 and 4 ' ' \ - 

Tabte 5: Measures Recorded in the Instrumented T-37 Aircraft , 



Parameter 



Range 



Elev Stick For.ce 

Aileron Stic ' or^^e 
, Rudder. Force 
' tlev Uor Position 

A'it on Position 

R jdder Position 

Throttle Position 

Low Altitude 
. Higii Altitude ^ 

Gs 
' Heading 

Yaw^ate 

Jrim Ta^ Position 

Pitch Rate ' 

Airspeed 

Roll Rate 

Roll Angle ^ 

Pitch Angle 

Right l:ng RPM 

Time 

Fvent Marker 
Linear 
^ Accclerometers (3) 
Angular 

Accclerometers (3) 



0-30 lb 
0-20 lb 
0.301b 
16^ +24^ 

' TuU 
- 0"-5m' 
0-25m 
-IG -j:5G 

o-aeo"" 

+70"* /Sec 
On -Off 
+90''/S'ec 
0-300K 
+10Q^/Sec 
0-2(>D° 
0 360! 

o-iia^- 



Actuated by* IP 
0±3g , 
2 rqd/sec 



Accuracy 



Sample 



+.1 lb 
il lb 
+.1 lb 

.5° 

+20' 
+50' 
+.1G 
+ 1° 

+1°/Sec 

4f/Sec 
+MK 
+ 1°/Sec 

+r 
+r 

+ 17' 



.Olg 

4°/sec' 



20 
20 

20 

JO 

20, 

20 

20 
20 
20 
20 

20- 
.20 

20f 

20 

20 
.20 

29 
20 
20 
20 

20 

20 



Table 6. Sortie Conditions Per Pilot in Aircraft 



Sortie 


Trial Order* 


A/S 


Inst/Cpntact 


1 


A 


200 


Inst 




B 


200 


Inst 


3 


A 


100 • 


Inst 


4 


B 


100 


Inst* 


5 


A 


200 


Contact 


6 


B 


200 


Contact 


7 


A 


100 


Contact 


8 


B 


100 


•Contact 



*Scc I-i):urc 4 for trial order. 



er|c 



■ 16 



13 




c: 
.2 

I 

8 
s 
•3 



a 

2 

D. 

at) 
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Trial 1 \ 

Sequence t - 

T S&L . 30* . S&L , 30* . S&L . 30* , S&L^ ^ 30* . 

- . If 



S&L - 3^2 min trials (opt I orja I ) 

/ 



Return to Base 



3 - I t S&L t 30* « S&L t 30* . S&L , 30* , S&L . 



S&L - 3, 2 mIn trials (optlonhO 
Return to Base -.1 
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Figure 4. .Order of trials for blocks of 2 sorties in Table''6i 



Data from the instrumented T-37 will be collected on stai|^ard climb, straight and level, 3p degree 
bank and des<^nt maneuvers. Maneuvers will be performed under instrument and contact ilight cd|ditions 
In sortie one (AFHRL-TR-75.97(II), Appendix E), data will be collected cumulatively fot atfernating 
trials between strai^t and level flight and 30 degree bank turns, sortie two reverses the maneuver sequence 
for counterbalancing. Each, pilot flies four instrument and four contact, sorties. Five pilots will fly the 
aircraft sorties and. repeat them in ASUPT. 

After completion of tlie conditions, listed in Table 6, data will be collected on stafls and loops, during 
which the aircraft will be flown closer to the limits of its performance envelope. Each of the pilot-subjects 
will fly eight stalls and loops, maintaining as close tolerance to prescribed limits as possible, while the 
parameters, listed in Table 5, are recorded. It is estimated that this step will require two more sorties per 
pifot. 

ASUPT-The Criterion Device ~ 

The development of 'system and operator peri^ormance measures are designed to provide objective 
data for trying to establish ASUPT as the criterion device. Validation of ASUPT as a criterion device not 
only would provide a means of increased ASUPT efficiency in UPT ^research, but also has major 
implications for future simulator validation procedures. 

-15 



Projected Research 

The foDowing suggested research closely follows the list of top priority issues given in Table 1. The 
proposed research will address both simulator hardware requirements and training methodology. 



VI. VISUAL DISPLAY RESEARCH ' 



As shown in Table 1, the definition of visual display eContent for contact flight training received the 
highest median rating by the panel oTeocperts. The important of the outside world scene in the simulator is 
underscored by data collected by Brown& Rust (1975). Tlie traffic pattern was found to be the most cntical 
element of flight instruction, and the mosr^^ifficult to teach and learn. Unfortunately, evidence on the 
specific features of the visual world which should be displayed in the simulator has not been pubhshed., 
Pnmary emphasis in ASUPT has been placed upon t/ic content of the visual display and its effect upon 
training tasks and maneuvers under varying conditions'iyf simulator motion. 

Definitive research dealing with visual or motion cueing must, of course, consider the interaction 
between these cueing mechanisms; however, preliminary studies on motion and vision alone can be 
undertaken with one of the two variables held constant. Though the basis of emphasis in a given study may 
be motion or vision, this approach does not imply a neglect or unawareness of possible interaction effects. 

Visual Research Objectives 

The overall objective of research in simulator visual displays is to identify essential visual cues which 
allow the pilot to control the attitude of his aircraft and to position it properly in three dimensional space. 
It is possible that the visual display for the naive pilot trainee should be composed of only features which 
enhance his control of the aircraft about its axes and the axes of three dimensional space! Later, he must 
learn to extract from the real world scene those objects which enhance his control and navigational 
functions. He must learn to discriminate these referents when they are obscured by visual "noise.'' (Visual 
noise denotes conxlitions which obscure the referents the pilot uses as cues. Atmospheric attenuation, 
smoke, haze or any condition which causes an object to have low definition consitutes such noise. To the 
extent that this noise degrades pilot discrirpination of changes between Ihe referents wlii^h he uses to 
control his aircraft, precision of controfis degraded). The identification and discriminatipn of changes 
between objects are hypothesized to be functions of the level of detail of the object arid background 
contrast. Tliese factors are controllable as experiifiental variables in ASUPT and may be varied 
systematically by the number of lines use^to define an object and the shades of gray used to provide 
contrast or between objects and background (figure-ground contrast). 

A Visual Model as a Tool for Research < C^ ' ^ 

The visual model described in Thielges and Mutheny (1971) served as a ^Isis for gei^rating 
hypotheses The model assumes that external referents in the real world and internallcferents associated 
with the vehicle being controlled can be projected using perspective geometry i4)on a picture-plane 
perpendicular to the pilot's line-of-regard. The relationship between^ the jnternal and external referents 
provides information with respect to the aircraft's departures from desired positions 'iiy six axes of motion. 
It is hypothesized that different positions of referents on the picture-plane will diflerentiaUy affect the 
pilot's ability to discriminate changes in aircraft position. For example, an external arid internal referent 
picked near the \/ertical mid-line and on the horizon of the picture plane will not/allow the pilot to 
discriminate as fine a change in bank position as if those referents were picked farthe/out on the horizon. 
Referents selected near the horizon do not allow as fine a discrimination of forw/rd translation as do 
referents chosen closer to the aircraft on the earth^s surface; i.e., downward from tfte horizon line on the 
picture plane. < j' 

The model assumes that it is necessary for the pilot to select internal and ^ternal referents in order 
to make discriminations of changes in the attitude and position of his aircraft ij) spa^c. The model defines 
the pilot's learning process as the identification of the most appropriate external and internal refererft$^f5r 
exercising closed-loop control. It investigates how the pilot extracts these /cues from the appropnate 
referents in the real-world scene; and, how he filters out "noise" in the rea|iWor|d scene. 

^9 ^ ^ . 



The model deals with five dimensions of aircraft control: (1) Pitch control alone requires only an 
identifiable reference object directly ahead of the aircraft^ on the vertical mid-line as near to the horizon as ^ 
ppssible. For each maneuver, the optimum placement of the reference object relative to the ground or sky 
plane is maneuver specific. For straight and Icvef fliglit, a pitch reference point ahead of the aircraft at the 
honzon bne, or the horizon Me alone, provides a reference against which the pUot judges pitch attitude.. 
For a nose down attitude dunng approach to landing, a reference object lower on the ground plane, is 
hypothesized to be preferable. (2) For bank control, objedts displaced laterally from the longitudinal center 
line of the aircraft provide greater positional displacement per unit of bank, the farther they are from 
center line -An object placed on the horizon at the vertical mid-line exhibits little perceptible movement to 
the pilot per unit of bank. The same object placed 30 degrees from the vertical mid-line provides greater 
displacement per unit of bank and allows greater contjol precision. (3) For heading control, objects on the 
honzon in the fonvard viewing area which the pflot can relate to an internal referent provide equal 
displacement on the display per unit of heading change. For pilot ease of scan, the object should be directly 
foward on the vertical mid-hne at the horizon. (4) For the detection of longitudinal motion of the aircraft, 
the pilot uses objects directly in front of the aircraft which appear to move toward it. Objegts directly 
below the aircraft have the greatest perceived displacement whUe those directly foward andx)n the honzon 
have tiie least per unit of longitudinal movement. To maximize Uie pilot^s detection of forward motion, 
objects nearly beneath tlie aircraft, proyide the greatest information for control. (5) Control of lateral 
displacement parallels that of longitudinal. For discrimination of displacement along the vertical axis, the 
pilot mu^ discriminate changes in the size of objects by^ recognizing changes in the relative distance 
between one edge of an object and another or the change in distance between objects. ' 

These visual cues allow the pilot to control the attitude of the aircraft about its three axes and to 
discriminate position changes in three dimensional spice'. The pUot must discriminate and identify objects 
which allow him to direct the aircraft purposefully from point to point in the fulfillment of some objective 
or mission. " 

Methodology 

Two novel aspects to\he methodology are proposed for investigating visual issues in simulation: (1) 
the use of eye-movement recordings, and (2) the utilization of ^^performance equivalence " 

Eye-Movement Recordings. Eye-movement recordings wUl identify the external and internal referents 
used by the pflot in the performance of UPT maneuvers. The identification of these referents will define the 
major visual variables to be investigated in ASUPT/Eye-movement records provide data for identifying 
environmental factors which inject noise into the visual scene. The objects in the visual display which cue 
the pilot to exercise aircraft control can be q\iite abstract; but it may increase the value of the display it 
terrain features ar^ recognizable. Eye-movement recordings^f experienced pUots flying UPT maneuver 
provide the method for obtaining information about fhe .objects and features in ^^e rea^ world scene u^^^^ 
by the pilot. A program for collecting and analyzing eye-movement data is given in AFHRL-lK-Z^-ZbUi;, 
Appendix F. - ^ 

Performance Equivalence m Visual Scene Investigations. The performance (Equivalence approach uses 
an experienced pilot to standardize input conditions. The effort will be made to define a. visual display 
which is equivalent to the real world scene in terms of performance by systematically rpodifying the visual 
scene in ASUPT. If the simulator system and operator performance are statistically the same as in the 
aircraft, the two systems will be assumed equivalent. 

Establishing a set of visual content conditions which provide equivalent performance (system and 
operator) for a specific task in the aircraft is of primary concern. The visual display configuration could 
then be taken as the criterion visual system for future experiments. 

For training issues, an investigfition of the relationship between visual display content and student- 
progress wUl be made systematically using tlie performance equivalent visual system' as a baseline. For 
example in trainmg the student to discriminate the visual cues for flare and landing, hypotheses regarding 
the optimum CRT resolution (number and pattern of lines displayed) for training may be tested. 
Instructional cues foreign to the real world scene also can be added to demonstrate the most relevant cues 
for the task (Payne, 195%). , 
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Proposed Exp«;rinjetira! Investigations ' * ' • . 

Fouf studies on content of tlie visual display are shown in Figure 5. They comprise. (1) establishriM^ 
of ASUPT as criterion system, (2) determination of transfer from that Vstem to the aircraft, and (3) 
evaluation of the performance equivalence approach, while o'btaining information relevant to two different 
configurationsof the visual display. ■ 
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TRANSFER EXP 
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POS.CQflTROL 



TRANSFER EXP. 
APPROACH AND 
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Figures.^ Proposed visual display studies and antecedent investigatio 



ns. 



> Two criteria can be used in establishing the ASUPT criterion visual system; first, equivalent 
PQrformancp by experienced pilots both in terms of system and operator output, and second, consensus of 
subjective opinion from experienced pilots that the visual scene in ASUPT is acceptable as an adequate 
cueing stimulus to the real world scene. 

. ^ , 

Major variables important to the investigation of the ASUPT visual display., are. (1) number of objects 
in the display, (2) position of the objects in the display, and (3) "stylization" or amount of detail per 
object. The number and placement of objects tested will be defined after analysis of the eye-movement 
data, ^though early hypothesis formulation may result from the visual model previously discussed. 

Visual Study L Using the NAC Eye Mark Recoi-der adapted to an HGU.26P flight helmet, a siijer 
portable camera, and 'a Singer portable video tape recorder, experienced pilots will fly contact and 
instrument maneuvers frbm the T-37 syllabus. This procedure will provide an accurate, objective record of 



the pilot's eye movements as he performs actual UPT nying tasks. Tlus process will be duplicated in ASUPT 
usine the same pUot subjects. If the recorded eye movemems show essentiaUy the same scan pattern, 
frequency and duration of focus in the T-37 and ASUPT, ASUPT wUl be supported as a criterion system. 

I'isual StiiJv 2. This study will employ the classical transfer of training paradigm discussed by Gagne, 
Foster and Crowley (1948). A small number (approximately 8) of UPT students will be trained in the T-37 
syllabus contact maneuvers using ASUPT as the criterion system. When these students reach proficiency, 
they will Advance to Uie fiight line for T-37 aircraft training. Their progress will be monitored and the 
average number of hours of fiying instruction required to pass their contact check ride will be recorded, 
This will be compared'to the average number of fiying hours for control group students to determine the 
training transfer achieved through the use of the simulator. 

Visual Studies 3 qiid 4. These experiments deal with the content of the visual display and are divided 
into two categones. (l}-determination of content necessary for control of the attitude and position of the ■ 
aircraft, and (2) definition of cues required for the identification and use of environmental featu1»s. Results 
will be generahzable to the spccifisation of displays for both simple and complex aircraft siniulato>S- 

The third and fourth studies allow the determination of feature.s of the environment which enable the 
pflot to change the aircraft's position in a purposeful way. The two major UlT tasks in this category are" 
(1) traffic pattern, approach and landing, and (2) formation fiying. The traffic pattern, including approach 
and landing has been researched more extensively Uian formation fiying, but recent work at AFHRL/FT 
using the formation fiight training (FFT) has provided data directly applicable to the specificati^gn of 
formation trainers. 

The variables and levels for studying visual cues essential for attitude and position control are given in 
Table 7. 

Table 7. Visual Display Experimental Conditions-Attitude and 
; Position Control v, 



Display Features 





Dimension of Control 


Condition 1 


Condition 2 Condition 3 




Pitch 


Criterion 
' ASUPT 
ystem 


Florizon line To be determined 
through 

equivalence tests 




^ Baltic^ 




Horizon line 


f 


Heading 




Vertical line sub 
tending T visual 
angle placed each 
45° in azimuth on 
horizon line 




Longitudinal 


f 


Grid pattern 
ground plane 




Lateral 




Grid pattern 
ground plane 




Vertical 




Grid pattern 
ground plane 



ERIC 



NOTE : 1 . Grid line spacing to he determined in pretest. 

2. Hgure-ground contrast to be determined through pretest to provide positive 
differentiation of figure from ground. 

3. All encoding in Condition.s 2 and 3 linisl be expcnmentaily determined in equivalence 
pretesting to insure non-cquivalenee for Condition 2 and^Squivalence for Condition 3. 

22 v. 
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The ASUPT visual display 'capabUity allows the presentation of the relevant referents for^tlie 
touchdown phase of landing. Satisfactory study of this fliglit phase has not been possible pnor t6 ASUPT 
The vanables and encoding suggestions for the approach and landing study are given in Table 8. ' 

Tables. Visu^ Display Experimental Conditions- Approach and Landing' / 



Display Feature 



Oimtnsion of Control 



Condition 1 



Condition 2 



Pitch 



Bank 
Headi^ 



Longitudinal 
Lateral 

Vertical . 



* Condition 3 



Criterion 

ASUPT 

system 



Horizon line 



Horizon line 

Vertical line sub» 
tending 1 visual 
angle placed each 
45 in azimuth on 
horizon line 

• Grid pattern, runway 
outline cross stripes 
each 100 yards 

Grid pattern, runway 
ij edges and runway 
centerline 

Grid pattern, runway 
edges and cross 
stripes 



To be determined 
through 

equivalence tests 



NOTE: 1. Cross stripe spacing may be modified after pretest. 

. 2. Figure-grorund centrist to be determined through pretest to provide positive differentiation 
of figure from ground. ^ ' - 

3. Encoding in Condition 2 and 3 must be expprimentaily determined in equivalence pretesting 
to insure non-equivalence for Condition 2 and equivalence for Condition 3. 

The essential features Usted under Conditions 2 and 3 in Tables 7 and 8 can be defined more 
accurately after the eye-movement records and the full visual capabflity of ASUPT have been analyzed. 

Studies 3 and 4 wiU test the performance equivalence approach for simulator development Thevwill 
assess the traming transfer to the aircraft of smaller FOV visual systems. The measures of number position 
and styhzation 0 objects wUl be varied so that. (1) a condition not equivalent to the cntSnSCT^^ 
obtamed, and (2) a condition equivalent to the criterion ASUPT system is obtained. Classical trahsfer of 
training experiments will be conducted to determin? whether equivalent systems yield a greater amount of 
transfer than n^n -equivalent sysitems. , 



The design format for Studies 3 and 4 is sliown in Table 9. 



Table 9: Design Format for Visual Display 



Condition 1 



ASUPT criterion 
sySjtem 



Data fr,om Study 2 
Figure 5 



Condition 2 



Non-equivalence to-^-*^ - 
ASUPT criterion system 
established uang^'* 
experienced pflots^ 

Students trained to 
criterion in non-equivalent 
system and transferred to 
T-37 aircraft , 



Condition 3 



Equivalence to ASUPT 
criterion systeni 
established usiftg "^^^ 
experienced pflots/ ^ 

Students trained to 
criterion in equivalent 
system and transferred 
to T-37 aircraft 
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Vn; MOTION" CUE RESEARCH 



Determining the i\e5essaiy axes of cockpit motion for •training simulators wa? listed sixth on the 
.gri9tity-list pf traming.isiues, Experimental manipulation oC motion, G-seat and gravity alignment cuemg is 
partioilarlyeasy using ASUPT. ' . ' ^ 

M fio'inted otTt by Smtli (1972), it is not feasible to invesUgate aU of the possible permutations of 
Ihe-six aJjes of motitfn, gravity Mignment and-tJ-scat configurations tha^ co.uld be used. Screening of these 
.variables hy, pretest experimentation or "common sense." is necessary.. The combinations of expenmental 
i'-cOjiditiQiis- to'be>^tudied may use either classical transfer methods or be approached through the 
performance eqtlivalence method. (In the discussion to follow, th^ perfonfiance equivalence method. is 
•assu'nfed.).'- , ^ • , , ' • ' 

'the Effective Time Constant Model 

, '.The' -Effertivi' Time Constant (t J Model (Matheny , 1569 ; Matheny & Nomian, 1968) provides a basis 
f<jr understan^^ig'the vision/motioi\ interaction effects as weU as to formulate hypotheses to be tested. In 
brief" .the model assumes that the precision of closed-loop error-nulling behavior js a function ot the 
immediV:y pf feedback to the controUing operator (e.g., the pUot). The time used for feedback to occur has 
been 'termed the -Effective Time Constant of the man/machine system. The value of t depends upon the 
modalities through which the information is received and the threshold level of those modahties. 

According to the model,'information about. the aircraft, particularly changes in attitude of the 
aircraft, is transmitted more rapidly as feedback to the operator through the motion senses than the visual 
senses The model assumes that the motion senses are cued by rates of onset of acceleration which allow for 
the initiation' of response much earlier than would be occured by the positional change of the visual 
- stimuias. Increasing the gain on a given display wiU increase the immediacy of the feedback to*e operator, 
thus inbreasing the precision of control. Likewfse, visual displays which provide the operatoV with rate 
acceleration4)t onset of acceleration information aUow him to receive more immediate information about 
the ^stem and to control it more precisely. 

'Fr6m the Effective Time Constant model, the prediction can be made that in systems such as the 
' T-37 aircraft, performance of the precise attitude control task will be enhanced by addhion of proprt 
•motion cues, while other 'tasks such as ■FX)sitional control in which the visual feedback is timely ajd 
adequate will not benefit greatly from the addition of motion cues It is further predicted that the visiial 
■ display which incorjDr|tes the higher gain will result in a higher precision of control. V 

% _ ^ . ■■ 

'Experimental Studies of Motion 

■ ' The overall question addressed by these experiments is: "under what method of introducing motion 
cues and across what conditio;is of flight are the control performances of experienced pilots equivalent ? 
Tlie determlnatioi?.of how pilot 'performance varies as a function of motion-cue conditions across differen 
maneuvers^nd different levels of external disturbances is the prime' research issue in this study. Particular 
, combinations of platform motion, G-seat and gravity alignment^yariables have been selected to obtain data 
. about ten specific research issues. .The experimental conditions are listed in Table 10 and matnxed with 
appropriate experimental issues Tn Table 11.'' 

Table 11 shows the 'experimental conditions required for providing information, on ten specific 
research issues deaUng with motion. Three data coUection sessions wDl provide information relevant to the 
ten research issues. The issues have been selected sequentiaUy so that successive data collection sessio^^^^ 
buUd upon earlier results. Combinations of coiiditions are examined to determine the relative contribution 
of levelVof the variable under study to pilot performance. Effects under one set of conditions guide the^ 
selection of experimental conditions in tlie next session. The incremental design «"^';"/^d„''y "^^^.^^^^^^ 
lecommended Design for Experimental Studies Using ASUPT" wiU be followed (AFHRL-TR-75-26(in, 
Appendix H). • . ' . 

* The iirst research issue listed in Table 1 1 requires data collected under experimental Conditions 1 10. 
1 1 15 16 and 17 Performance under these conditions will show if the major simulation conditions ot; (1) 
no'moJion' (2) six degrees of freedom platform, (3) six degree of freedom platform with gravity ahgnmfsnt 
(4) S deg;ee of freedom platform with full G-seat, (5) six degree of freedom platform with full G-seat and 
gravity alignment, and (6) G-seat only, differentially affect performance. . 

■ " 24 • ' 
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Table 1C\ Experimental Conditions for Motion and G-Seat Studies 



Experimental 


Xondttlon 


Condition 


DeicFiption* 


1 ' 


No Motion 


2 


P,R (Platform) 


3 • 


P,R,Y (Platform) - 


4 


P, R, Y, H (Platform) 


5 


P,R,H (Platform) - ' 



6. P,R,H, L (Platform) . ^ 

7 . ' P,R,H,F,&^ (Platform) ' 

8 P,R,H,L, F,& A (Platform) 
^ 9 P,R,Y,H,L (Platform) ' ^ 

10 6 Degree of Freedom Platform 

1 1 6 Degree of Freedom Platform with Gravity Alignment 

12 P, R (Platform) With Gravity Alignment 

13 T, R, H (Platform) with Gravity Alignment 
W P, R, Y, H, L (Platform) with Gravity Alignment 

15 6 Degree of Freeilom Platform with Full G--seat 

16 6 Degree of Freedom Platform with Full G -seat 
' and Gravity Alignment 

17 Full G -seat only 

18 P,R(G-seat),H(Platform^) 

19 , - P,R (Platform), H(G seat) 

20 P, R (G- seat) . > , 
2I>.^ R,R.F.& A (Platform) . 
22 - Honly - ^ 

*Lcj;cnd' ^' 

P Pitch ' ♦ ■ 

R-Rol! , 
Y Yaw 
M Hc<ivc 

* L f.atcral ^ • - 

r&A J orc<in(I-afr 

ff experimental Conditions 1 and-IO dif^rentiaily affect perfori/anle, the second session will be 
performed rising experimental Conditions 2, 3, 4. S., 6, 7, 8.0, 2J ^ and 2^ lo\detcrinine (lie com'bination of 
•"'^afes of mot io;i that are equivalent. * 

As a tesf^S|>the performance e(|uivalcnce approach, it is proposed that Conditions I (no motion),^ 0 
^full motion) a^tl conditions found to be ecjuivalent to full motion be used in the paradigm shown in Tabic 
12. In this paradigm, equivalence and non-equivalcnce arc established by the methods outjined on pages 14 
through 16. (It is assumed that a condition of less than the full criterion ASUIT/ system may be 
established.) 

fn the^ final session, expeninental Conditions 12, 13, 14. 18, 19, and 20 are investigated. Comparison 
of Conditions 13 and 5 will answer, the question of the contribution of gravity alignnierit to a two degree of 
freedom platform (i.e., one with pitch, roll and heave). Analysis of the second research issue may redefine a 
' nominal platform and, therefore, change this assumption. 

The comparison of Conditions 15 and- 16 is designed to investigate th^ contribution of gravity 
alignment when maximum platform is used with die G-seat. 

The comparison between Conditions 2 and 12 gives information about the contribution of gravity 
alignment with minimum motion platform (i.e., one which provides only pitch and roll ^timuli). 

Condition 14 will be compared with Conditions 9 and 10 to analyze the longitudinal acceleration cue 
.contribution when maximum motion platform is used, i.e., whether the gravity alignment or fore-and-aft 
translation effects performance. 

o 2t) • . 





ERIC 



22 



« 



'•0 . 



c 
.2 

o 

S ' 

e 



5 



o 
o 



^5 



X 



c 

c 
o 
U 



c 

X 
U4 



I' 



CN4 



CN4 
O 

o\ 
in 



CO 
lA 



UJ 



* LU 



erJc 



X 
X 



X 
X 
X 



X 
X 



X 
X 
X 
X 
X 

x^ 

X 



o 



(0 



B 

o 
o 

0) 
L- 



o 



in 
o 

0) 
L- 
O) 

Q) 



(A 
(0 
(D 
L. 

L. 

o 

— > 



4b 



c 



P4 



X 
X 



c 

.o 



3 



c 

o 
o 



C £ 

E O 
c 

— (0 

(0 O. 
E 

> — 

O £ 



X 
X 



X 



C 
O 



c 
O 

o 



C E 

£ O 

C 

— (0 

(0 a. 



> 

(0 
L. 

o 



E 
O 
c 



c 
O 

4- 
-f- (0 

L- O 

^ c in 
O 3 
u — 
a. 

4- 

. c E 

£ O 
c *^ 

(0 

(0 ex. 
> *— 

CD £ 



c 
o 



. 3 



c 
O 

o 



C E 
— (0 



in 



23 



2G 



\ 



X 



(0 



I 

E 

L- 

<D Ot'O 
3 C 

(0' 

(0 

C — O 
Cl 

O 

E 
3 
E 

O — O 
— X 

o <s 

O £ c 
O 



o 
c 

4- 



I £ 

c 

c o> 
o 



(0 a. — 



> £ 

:i: i 

> 

O £ 



(0 

•O 3 \ 
3 ^ >* 

C C (0 

o o 

— 1 U C7) 



. X 



O E 

o 

C 4- 
^ (0 
a. — • 

c a. 

CT) 

— E 
(0 B 
X 

>; 

(0 I 
L. 

0)4^ 



3 TJ 

4- C 

— (0 

in O' 

3 o 

CO H- 



oo 



X 
X 
X 





£ 


O £ 






o 


' o 






4- 


^ C 4- 










i 










(0 E 






c 


>- c 


O 


H 




— £ 


4- 


> 


3 


(0 t 


4- 


L. 




07)4- 


4- 


*^ 


in 


® (0 


jO 


4t- 

3 "O 




4- C 




(0 






(0 


"(A © 


o 


^ L- 


tn 


3 O 


1 






• 


• 




o 



Table 12. Paradigm for Test of Performance Equivalence Method for 
Motion Requirepients ^ 



Condition 1 



Condition ^ 



Condition 3 



No-motion-non- 
equivalence^to ASUPT 
criterion system 
established using 
experienced pilots 

Students trained to 
criterion on this system 
and transfened to air- 
craft 



Equivalence to ASUPT 
criterion system 
established using 
experienced pilots 

Students trained to 
criterion on this system 
and transferred to air- 
craft 



ASUPT criterion 
system 



StudentfiUigined to 
criterion on this'" 
system and transferred 
to aircraft 



For all three sessions, ihe experimental conditions will be applied to instrument flight using the 
maneuvers of straight and level flight, 30° bank turns and unusual attitudes, Three levels of disturbance 
(g.g,, none, medium, high) will be impjosed upon the basic flight tasks to determine the equivalence-^ 
physical systems across representative tasks and disturbances. Disturbance level for conditions will be 
detexmined through pre-testing of the turbulence generation system of ASUPT. 

Motion-Visual Interactwn Study ^ 

Results from the visual and motion studies will guide an experiment on the interactive effects of these 
two variables The experiment will be conducted using visual cues that the pilot use's to control aircraft 
attitude and position. The experiment is designed to determine if different platform motion conditions 
produce differential interactive effects (Table 13). , 



Table 13. Experimental Conditions for Initial Motion-Visual 
Interaction Studies 



lasks 
Variables 

•Subjects 



Approach to landing'. 
Straight and level * 
Motion-no motion and full 6 degree 
'Turbulence-liigh and low 
Precision of control-high and low 
Experienced pilots 
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It is hypothesized that the motion-vision interactive ^effect is influenced primarily by the level of 
precision and control required and the nature of^the external forcing functions (typically, turbulence) 
imposed upon the system. The first interaction experiment will examine close precision attitude control in 
which the interaction effect is likely to be greate|t, as predicted by the effective time constant model. 

The performance equivalence paradigm will be^sed for this experiment. Experienced pilots will fly 
each of the conditions and- tasks to deterpiine whether their control behavior differs under the various, 
conditions when aircraft performance remains constant. In possible follow-on 'studies, performance of 
groups or*-5ludents trained under, each condition .and subsequently transferred to the aircraft will be 
compared' as a furth'eMest of the validity of the performance equivalence approach to developing ASUPT as 
a criterion de.vice. . ^ , . 
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: / Vni; TRAINING METHODS RESEARCH 

This report does not address training metliods research in depth inasmuch as the long term use of 
ASUPT in this regard is the basic mission of AFHRL/FT and is continuously documented in Project 1 123 
and the AFHRL Research Program. Consequently, the following discussion is intended only to highlight 
key areas of interest. 

• Training method research has high potential for producing results which wUl increase UPT program 
^ effectiveness. The basis for the proposed research is the establishment of ASUPT as a criterion system for 

investigating training methods. This is particularly critical for research in two areas", cognitive pre-training 
and feedback. 

'" . * 

• Cognitive pre-training refers to practice on the intellectual elements and understanding of action 
requirements in a task prior to its being formally trained. For the perceptual and cognitive aspects of flying 

~ tasks (e g., learning to scan, read and interpret the instruments or learning procedural sequences) 
multi-media instructional aids provide highly effective and inexpensivft.^training. Mental practice may -be 
exceUent training for continuous control tasks through use of simple devices or even no equipment at an 
(Prather, 1972)'. . - 

'Flexman et al.,(1950, 1954) support Inclusion of cognitive, pre-training dirertly into the training 
program These techniques require the student to become proficfent at ver.baUzing; pertinent cues and 
res^ nses necessary to meet the requirements of the task. The instructor determines whether the student is 
merely "panoting" the words or whether he understands the concepts and responses required for 
accompBshing the task, Inv.estigation of the time savings through the use of cognitive pre-trainuig methods 
is highly recommended. 

AFHRL/FT has an audiovisual instrument training device (AVIT) programmable for cognitive 
' pre-training in scanning, reading and interpreting the instruments for basic instrument flight. The capabibty 
of AVrr to reduce simulator training time in teaching basic flight maneuvers will be investigated. A 
functional description of the device is given in AFHRL-TR-? 5-26(10. Appendix G. Usuig tune to reach 
criterion proficiency in the simulator as a dependent variable, an experimental g[oup wdl be trauied o 
criterion proficiency in AVIT and compared with a control group trauied only ui the simulator. Both 
oroups wai be taught- all maneuvers in the basic instrument UPT flight curriculu^^ the degree 

of generaBzation f^m the three maneuvers trained in AVIT to other fnane^^ained ui the^ulator. 

The capabflity fof AVIT to teach perceptual cues required in contact maneuvers will be investigated. 
If the major portfan of the learning task of the^ student is composed of perceptual ^nd cognitive 
factors as contrasted to motor responses Jt is liypothesized that once the studpnt has '^amed-Jie des ed 
stimulus relationships, recognizes departures from these desired relationships, and knows in which direction 
he should initiate control movements to correct them, his training time wUl be sifriificantly reduced. 

Feedback » * ' 

^ • Feedback (i.e., knowledge of results) facflitates training (Smode, 1958). Ca:utiQjis, however, should be 

observed when applying this principle to particular tasks. For example, Briggs (1962) pouits to the 
toterSve effect of augmented feedback (positive or negative), complexity of tte feedback criteria and 
kvel of training. He also draws attention to the importancfe of the feedback withdrawal schedule. Ward and 
Sanders (1966) suggest that adding feedbaqk to the task has a workload associated with it and may uitertere 
. with carrying out the primary task. 

Feurzeis (1971) ETOvided instructional monitoring as a method of feedback. The trainee was given, 
computer generated diagnostic information, instructional suggestions and a two-dimensiojial dynamic 
display'of his progress through a holding pattern. This technique should prove quite beneficial m UFT.but 
interference effects and feedback withdrawal schedule must be investigated. 

Sequencing of Tramin^asks 

Sequencing of training tasks was listed as a top priority issue by the traininglssues panel. Sequencing 
problems are more properly solved using the instructional system development (ISD) task analysis approach 

' « . • ~» 
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suggested in AFM 50-2 Separate tasks also may be approached through research in training methodology 
(e.g , cognitive pre -training and feedback). The comparison of two sequences may be tested using ASUPT as 
the criterion device, within Which aH training is given and final training i^aested. This comparative 
experiment should be undertaken after thorough analyses of the tasKs and should mclude a synthesis of the 
tasks of the total curriculum based upon the task analysis suggested by Meyer et al., (1974). 

Contextual Training ' . _ 

The arguments for investigation of contextual training -are identical to those just presented for 
sequencing of the training tasks. The context within which certain tasks are to be, trained should be 
established and synthesized by task analysis prior to experimental investigation. Comparative studies of the 
issues for "contextual" training diould then be inwstigated in ASUPT using it as both the trauiuig and the' 
criterion device. > 

individualized Instruction 

A data base wfll be developed for guiding management decisions about individualized instrucUonal 
programs Adaptive instructional strategies and incentives could guide the trainee's progress as a function of 
his rate of skill attainment, biographical background and other individual characteristics. Two major 
research thrusts are foreseen for AFHRL/FT in the area of individualized instruction. First, techniques for 
effectively and efficiently individualizing instruction into flying training programs wOl be developed and 
evaluated Sepondly, the managerial aspects of implementing individualized instructional programs into the 
operational environment wiU be considered. 



IX. CONCLUDING STATEMENT 

This volume presented a precis of a much larger and more detailed document. If the reader desires 
further clarifying information at'this point, he should refer to AFHRL.TR-75-26(n). Also, as concems the 
programming of AFHRL/FT facilities illustrated in Appendix A, it must be remembered that aD plans and 
research activities are dynamic in nature. They. are. subject to change as additional information is acquired. 
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APPENDIX A: AFHRL/FT CALENDAR YEAR, 1975 RESEARCH PROGRAMS 



Hardware Configuration 

* 1 Motion G-Seat-Visual Interactions 

2 Visual Display Brightness and Motion Interaction 

3 The Contributions of Motion tD Training - I 

4 The Contributions of Motion to Training - II 
Software Configurations 

1 The Development of ASUPT as the Criterion System 

2 Pilot Discrimination of Motion Simulation Conditions 

3 Visual Cue Utilization During Flight 
Training Methods 

1 Automated Performance Measurement 

2 Orientation Ride Pretraiming 

3 Task Load Measurement ^ 

4 Simplified Instruction of Normal Landing 

5 Evaluation of Prereviewed Demonstrations i 

f 6 Fatigue £ffects During Acquisition of Flyin^Skill 

.7 F-15 Emergency Training * \ 
Operational Effectiveness \ 
1 studies of Operational Utility: I \ 
Systems Engineering \ 

1 Formal Hel icopter Demonstration - \ 

2 A-10 Demonstration _ \ 

3 Ideal Airport Data Base V 

4 Cross-Country Airport \ 

5 Data-Base Ref inorrr^fnt 

' 6 'Motion Actuator Vr-loc1ty Distribution 

7 ^ Control Landing/Ground Requisition 

8 'Non-Linear Dervice for G-Jcat ^ 

9 Buffet Philosophy 

10 ASURT Wing Irnpl orf*^^ntation 

11 Flight Modulo Rodosign 

12 CIG Softwciro Rodosign 

13 Dual.RTM Upxlates 

14 BPS Dual Disc 

15 PR Completion . • 

16 Configuration Baseline 
t7 System Expansion 
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